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This report is an evaluation of a New York City 
school district educational project funded under iitle I of the 
Elementary and Secondary let of 1965* The major objective of the 
program was to increase student competency in math computational 
skills* Ipprosimately 3,000 high school students in grades 9 through 
11 from 32 high schools were selected as participants* Class size was 
reduced to 15 students to allow for individualized instruction^ Math 
labs eguipped wit,h calculators, printing calculators and programmable 
calculators were available for student use* Their use was designed to 
interest atudents in iqath and to make students familiar with these 
machines since they are often used in business and might increase 
students • employment opportunities* The program was staffed by a 
project coordinator, teacher^trainers, teachers, and teacher^aides* 
The Metropolitan Achievement Test (MlTs) Computational Subtlest was 
administered as a pretest and as a poatteBt^ i historical regression 
analysis of the achievement test data revealed statistically 
significant differences in the scores. Program participants, on the 
average, made one year gains in actual achievement beyond that which 
was predicted on the basis of their .previous history of achievement. 
(Author/BS) 



* Documents acquired by ERIC include many informal unpublished * 
^ materials not available from other sources* ERIC makes every effort * 

* to obtain the best copy available. Nevertheless, items of margi;aal * 

* reproducibility are often encountered and this affects the quality * 

* of the microfiche and hardcopy reproductions ERIC makes available * 
^ via the ERIC Document Reproduction Service (EDRS) , EDRS is not * 

* responsible for the quality of the original document* Reproductions * 

* supplied by EDRS are the best that can be made from the original* * 

^ ^ #1 lie ^ 1^ Ifii Jii III ^ lii 1^ 3^ ^ i| ^ 3jc ;|c i^E 4s 4^ ^ % 



ERIC 



EVAtUAXlON REPORT 



ftoctlori No. 09-5967S 



RlJffiDIAL MATHKMATIdS SKILLS PROGRAM 
FOR OPTIONAL ASSlONlfflNf PUPILS 



SCHOOL flAR 1974-75 



Sheldon B, Kastner, Ph.D. 



US □iPARTMiNTOr HEALTH. 
iDUCATlON 4 WiLFARg 
NATIONAL iNSTlTUTa Of 
EDUCATtON 

THiS OOCU^iNT HAS BEEN REPRO- 
DUCED EXACTLY A-l RECEIVED FROM 
THE PERSON OR ORGANlZATiON ORlDIN- 
ATiNG IT POINTS OF VIEW OR OPINIONS 
STATED 00 NOT NECESSARILY REPRE- 
SENT OFFICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICY 



oo 



An evalTialiloa of a New Tork City School 
district educational projact funded under 
Title I of the Elemeatao'y and Secondary 
Education Act of 1965 (PL d9-10) perform- 
ed for the Board of Education of the City 
of New York for the 1974-75 school year. 




Dr. Anthony J, Po'iemenl^ DlESCtor 

BOARD DF EDUCATION OP THE CITY OF NEW YORK 
OFFICE PF EDUDATIPNAL EVALUATIDN 
IIP LIVINUSTaN OTHEET, DROOKLYN, N. Y. IIBDI 



ERIC 



Table of Contants 



Chapter . fmge 

I frogrm 1 

III Findings 5 

IV Stamawry of findings i Conolusions 10 

V E3€©mplary ft'ogram Abetraat 12 
App#ndlic 



3 



List of Tables 



Table NTmber 



1 



Historical Regrtssion Analysis 
MAT Mth Computatioas Sub-Test 



Ghap^Qr The Prop^am 

Tht main objaotiTC of this program la to Improve achie-rement 
in fundamental sathematies skills in high school ^o ar© two or mora 
years retarded in mathematics, 

Projeat Activities i 

The basic premise of this program is that hi^ school studente 
who have not as yet demonstrated competence in basic arithmetic 
operations and concepts ^ need special attention* To meet the special 
needs of these students the' prop^am is designed to provide ^individtm* 
lised^ instruction* In addition ^ small group instruction and full 
claaa instruction were also ^^ed when appropriate. The process of 
individuation required the teacher to design a remedial ma.theiffiatics 
program which focused on the particular needs of each student* To 
implement Buch a program the teacher had to be knowledgeable in 
mathematics and its application, familiar with various materials and 
equipment I as well as be able to motivate students by planning mean* 
Ingful activities*. 

Glass sizes have been reduced to approximately 15 students per 
class to allow for greater individualized instruction* Jtoth labs are 
equipped with hand operated calculators , printing calculators and 
programmable calculators* The use of calculators i desk and program* 
mable, is one of the most innovative features of the program. The 
machines art used to encourage students to explore many aspects of 
mathematics. In addition, the machines are often found In many 
businesses and the students famlllM*ity with their operation may aide 
thelr employment opportunities. The machines can be used to provide 
iEBBediate feedback and thus indicate areas ^ere further practice is 
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2 

aaaded. 

Each clasaroom is staffed by a teacher and a teaohar-aida . The 
teachar-aides duties include one-to-one instruction, development of 
matarialSj and clerical. A teacher- trainer la available to each 
school to aaaiat in the organiisatlon and implementation of the pro«» 
gram. Taachar- trainers provide Informtion concerning materials, 
equipment, and ideas for tsacher i^epared materiala* Consultations 
batwaan teachers and teacher-trainers take place at home schools or 
at the Bi^eau of Mathematics. Such conaultationa also allow for an 
exchange of ideas which have proven suceeaaful in other classrooms* 

Subjects: 

The criteria for selection of atudant particlpanta were Optional 
Aasignment Title I high school students who were at least two years 
retarded in computational skills aa determined by the moat recently 
adminiatared standardised teat* These are pupils who are unable to 
complete their mathematics requirement for the diploma* Students are 
recommended for the supplementary prop*am by the mathematics or 
business education department chairperson, teacher, grade advisor 
or guidance counselor* Within 15 school days after the component 
was implemented, a list of student participants was formulated* The 
list contained the folloidng Information: name, class, grade, home 
address, standardised test score used for his selection, name of 
test, and date of administration. Participating pupils attend the 
supplementary math class five times a week for one period per day. 
Glass sise was 15*20 atudents. Diagnostic testing was done at the 
begiiming of the program and an individualised remedial prescriptive 
program was prepared for each student • Remedial prescription was 
assigned on a daily, weekly or monthly basis* Each set of lessons 
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were designed to overcome a singlt skill deficiency. As each dif* 
ficulty was overcome the process was repeated for another area of 
deficiency^ Progress is recorded and checked by the teacher or 
educational assistant. 

^irty-two high schools participated in the Remedial Bteth Skills 
Program for Optional Assignment ^ ^enty^four hl^ schools participate 
for the entire year (September 1 - Jtane 30, 1975). Eight high 
schools ran the program from Febriiary 1975 to June 1975. A total of 
3125 pupils were to be serviced by the program. The supplementary 
classes were rtm during the re^lar school day between the hotffs of 
8*30 a.m* and 5-00 p.m* 

Chapter lit Evaluative Procedures 

Program Objective I- Pupils pwticipatlng in the Optional Assignment 
Math program will show a significant increase in computational skills 
as measured by the Computation Test of the Metropolitan Achievement 
Test. 

Evaluation Objective I: To determine whether , through participation 
in the Optional Assigmnent Math Pro^amj the computational scores of 
the target population will improve sipiificantly as measured by the 
MAT Computation Sub-test. 

Subjects: All pupils who have participated in the supplementary 
Optional Assignment VlAth Progrfi^. 

Methods and Procedures: The appropriate forms of the MAT Iteth Compu* 
tat ion Sub"test ymm administered at the beginning and end of the 
program. Testing dates were as follows* 
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Pre-tcBt Poat»test 

September, 1974 February, 1975 

Februai^, 1975 May, 1975 

Pupils on one semester cycles were pretested either In September 
1974 or February, 1975 and postteated in eitte r February or .May, 
1975. Pupils on two semester cycles were pretested in September, 
1974 and were posttested in May, 1975. Alteraate forms of the MAT 
were used for pre- and posttesting. The Advanced High School Level 
of the MAT was used. 

Data Analysis: Data was analyzed by the "Real Post-test versus 
Antieipated Poat-test design". A "t" test for correlated data vras 
used to deteiTnine significance level. The ,05 level of probability 
was used as an indicator of level of sipiif icance , 

Evaluation Objective XI: To evaluate the extent to which the program, 
as actually carried out, coincided with the program as described in 
the project ■proposal. 

Subjects: All participants In the program. 

Methods and Procedures: In order to evaluate the quality and extent 
to which the prograB has been implenanted, close monitoring of the 
program was carried out by conducting site visits, by examining 
documents related to the implementation of the program, and by main- 
taining continuous contact with the project coordinator In order to 
obtain data on all aspects of the functioning of the program. 

Analysis of Data: A statement concerning the extent of Implementation 
lirlll be made in a later section* 
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Chapter III* Findings 

Evaluation Objective I: To determine whether, through participation 
in the Optional Assignment Itoth F^o^am, the computational scores of 
the target population will improve si^ifieantly as measured by the 
MAT Computation Sub-test* 

Table 1 contains the data relevant to the first evaluation 
objective. 



Table 1 

Historical Regression Analysis 
KAT Jbthematies Computations Sub*test 



Grade Level 


N 


Pre-Mean 


Predicted 
Post 


Actual 
Post 


ft* 


P 


9 


925 


5.90 


6.22 


7. Id 


24.56 


.001 


10-11 


1535 


6.33 


6.63 


7.52 


32.91 


.001 



The data contained in Table 1 has been grouped by grade (9th and 
10-llth). The data for 9th graders in the program indicates that their 
actual post-test scores in Math computation was aignificantly greater, 
than their predicted post-test scores. A comparison of the mean 
actual post-test scores with the predicted post-test scores indicates 
a .96 difference between the two means* Kiis .96 differerice indicates 
that participants in the pro-am showed nearly a full year growth in 
Math Computation above what would have been predicted based on their 
past history of computational achievement. A test of significance 
between actual post**test scores and anticipated post^test scores 
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repeals highly significant differenca (,001) with the actml post- 
teat score being hi^erp The data for 9th graders supports the 
program objective of increasing Math computational skills. 

Table 1 also contains data for 10th and 11th graders » The data 
for lOth-llth graders also supports the program objectives of inereas* 
ing Pteith Coraputational skills^ A comparison of actual post-test 
scores vrtth predicted post^test scores Indicates a *9 difference* 
Consistent with the 9th grade data the actual post-test computational 
scores are nearly a year hl^er than the predicted computation scores. 
Test of significance indicates that this difference (actual versus 
predicted) is highly significant (.001). 

In suDmaryj the data in Table 1 for 9th and IC^h-llth graders 
supports the program objective which stated that as a result of 
participating in the program students will show a significant gain In 
Math computation as when MAT scores are analyzed by a "Real Post- 
test vs. Post-test design*^. 

Discrepancy Analysis- 

The degree to which the program was implemented as described in 
the project was evaluated by site visits, contact with the coordina*- 
tor, and examination of docmnents related to program implementation. 

Site visits focused on evaluation of adequacy of facilities, 
materials, and equipment. Interviews were also conducted with 
teaehers and educational assistants. Among the schools visited the 
facilities assigned to the Optional ffeLth Program varied from excellent 
to adequate. In all cases, as called for in the guidelines, a special 
room was set aside for the math program. Rooms were equipped with 
adaquato electrical outlets so that machines could be effectively 
used. Most rooms had adaquate space to avoid overcrowding between 



students using machines and those using workbooks • In many instances 
schools provided facilities vihich were near perfect lab set-ups • To 
fiirther enhance the program many of the rooms were physically set 
apart from other classrooms* This allowed for privacy and a quiet 
atmosphere which aided motivation* In older schools the program was 
often housed in a re^lar classroom with unmovable desks and chairs. 
Such set-ups with permanent fixttires tended to make the program more 
difficult to implement* However , all facilities visited were at 
least adeqtiate and within gtildelines presented in the original pro- 
posal* All facilities had electrical outlets for calculators, security 
closets, space for supplies and file cabinets for students' work and 
records* 

Materials, Equipment and Supplies: 

Interviews about materials, equipment and supplies with teachers 
at the various schools indicated general satisfaction with delivery 
of materials. All teachers reported receiving a full compliment 
calculators and adding machines* There were reports of machines need- 
ing repairs and some delay in obtaining such repairs* There was a 
clear cut procedm^e for reporting of repairs to the central offioa. 
Workbooks, math games, and other materials were plentiful and 
prominently displayed and within easy access of students* Some teachers 
felt some material and books were of particular value and would have 
preferred greater quantities of such materials* File cabinets, 
closets with locks, and file folders were available at all sites. The 
program had adequate materials, equipment and supplies* Observations 
made on site visits indicated that facilities were supplied with 
materials described In the program proposal* 
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Teachers and Educational Assistants i 

As a ^oup tha teachers and educational assistants were motivated 
sensitive and interested in their students. Most were very enthualas- 
tle about the program* Interviews %d.th teachers revealed that they 
were knowledgeable about program objectives* Uiey also indicated that 
their contact vAtiL the teacher- trainers were quite helpful « Such 
Interchanges vdth teacher-trainers provided information eoncerning 
use of machines and equipment, new materials, and ideas for working 
with students with special problems. Educational assistants were an 
Integral part of the program. Educational assistants worked with 
individual students and small groups * ^ey also helped with clerical 
functions and record keeping which allowed the teacher more time for 
direct instruction. The educational assistants' enthusiasm and 
rapport with the students Is a major element of the success of the 
program, 

Teacher-Trainers * 

Information concerning teacher ^.trainers *ras obtained through 
direct meetings with trainers, discussions vdth teachers, assistants, 
and project coordinator. The most relevant Indieator of the suet ass 
of the teacher- trainer would appear to be the teachers and assistants 
feelings about the degree to which the trainer was helpful, I^om 
interviews conducted with the teachers and educational assistants the 
clear impression was that teacher-trainers were of great importance 
to the success of the program. Teacher^tralners provided many helpful 
teaching and organisational suggestions. They also serve as a vital 
link between the schools and the central math office. Thus requests 
for materials, eupplies and repairs for equipment could be filtered 
throiigh the teacher^ trainer . Trainers also aided in the evaluation 



process by providing test mterials and raceiving data collaetlon 
shtits. In addition, to direet contact with teaohars at the schools 
the trainers also w^rm involTed in the organisation and impltmentation 
of training seminars. 

Project Coordinators 

The project cQordinat or displayed a great deal of skill in ef- 
ficiently managing a complex program, Hla reaponslbllltles included 
selection and distribution of materials and equipment | in-service 
training, the development of program objectives, and the coordination 
of the data gathering process* Administration tasks were carried out 
in an organised and effective maimer. Teachers reported having re- 
ceived sufficient materials and supplies, repair of equipment was 
promptly handled, and the data collection process was well ol'ganlzed* 
Program priorities and objectives were clearly stated and effectively 
transmitted to teachers, trainers, and educational assistants thro\igh 
the project coordinator's office. 

In suirttnary, it was evident that the program was implemented In 
a manner which was consistent with the gid.delines set forth in the 
original project proposal* Adequate facilities were fotrnd at all 
sites visited. Class size was reduced to between 15-20 studenta per 
session* A check of the student rosters indicated that all students 
enrolled in the program were at least two years behind in computa- 
tional skills* Materials, supplies and equipment were Issued to all 
schools* Calculators and other electronic eqtdpment as described in 
the proposal were in use in all remedial classrooms. Individualized 
instruction In the fora of one to one and small group instruction 
was observed on site visits. A check of teacher schedules indicated 
that each teacher was scheduled for five remedial classes as stated 



in the project proposal. Teaeher-tralners ware observed to have made 
ragular visits to their assigned schools* 

Implamantation of Previous Reconmendationa : 

The follovdng are some of the reeofimendatione which were made in 
the 1973-74 evaluation reports 

!• Hiring of an assistant to the coordinator. 

a. This reeonmendation, has bean implamantad* 
,2, A more Intensive training pro-am. 

a. l^e addition of teacher-strainer positions and the ex- 
perience gained from last years program the training 
program appsars to have become more effective. 
3 • A supportive atmosphere that encourages stiidents to laarn with- 
out embarassment # 

a. This racoimendation has been most sucassfully implamanted 
in those schools with flexible physical arrangaments . 
Some schools ware able to set up attractlva labs in areas 
which were relatively private. Students could thus enter 
the rooms iiri. thout feeling conspicuous. 
4. Program should be recyclad. 
a. This is being done. 

Chapter IV: Sunmaryi Conclusions, and Re commendations 

The major objective of the Remedial Mathematics Skills Program 
for Optional Assignment was to Improve the computational skills of 
the program participants. Approximately 3000 9-llth grade high 
school youngsters who were at least two years behind in computational 
skills were selected to participate in the program. The program was 
geared toward Indivldualigad instruction utilizing a variety of 
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materiale and electronic equipment • Historical regression analysis 
of pre- versus post-test achieYement test data indicated statistically 
significant differences* Students participating in the program showed 
on average approximately a year gain above what had been predicted 
based on their previous computational achievement* 

These significant findings are supportive of the major program 
objective. The recoraiendations which follow are based on the suoess- 
fui findings that the pro-am has achieved* 
!• ThB program should be recycled. 

2. Because of the encouraging findings the scope of the program 

should be broadened to include other areas of mathematics ^ ^*S«f 
problem-solving. 

3* The possibility of coordinating the math program with the remedial 
reading program should be explored* Both programs seem to be 
dealing with similar yoimgsters and a program integrating reading 
and math would appear to be a useful combination. 
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Chapter V: Exemplary Program Abstract 

Component Identifications 609l6-720«801 

The major objective of the Optional Assignment Math Program was 
to increase tht ^computational skills of high school students who were 
at least two years behind in their nath computational skills. The 
Instructional philosophy of the Optional Assigiment Program was indi- 
vidualized instru^ctlon. In addition to individual and small group 
instruction Innovative use of mechanical and electrical calculators 
was an integral part of the propram, Studants upon entering the program 
were given diagnostic tests and from this Information an Individual 
remedial program was constructed. Teachers and teaching assistants 
received guidance in program development from teacher-strainers. The 
overall program was efficiently managed. All facets of the program 
ware integrated and resulted in a highly effective program. Data 
arialysis indicated that participants in the program showed, on average, 
approximately a one year gain in actual computational achievement 
beyond that which was predicted based on their previous history of 
achievement. Approximately 3000 high school youngsters participated 
in the program. 
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MDIAL MATHEMATICS SKILLS FROGfiAM FOR OPTIONAL ASSIGmiNT PUPIU 
' Function No. ' 

Use Table 30A, fot IHstertcfll Rearlls.lgn Design (6-Step Forniula) for Rsading (En|liih); Math (EniUBh); ReEdin| (Hon- • 
English); Kath (Kon-lnglish). , 

30A, Stiindsrdked Tgs£ RisuUa, " ' 

In the TabU Wlo^^ inter the fiquestid infarmatlon about the Eeits usid to tvaluate the iffeetlveniis of sijQr ' 
projiet CQHipenenEe/aQtlvUiis in achieving ■dssired objecElves. This forni raqulras niiani obtained froni sesres 
in tha torn of grade ^uivalant ynlEi as processad by the 6 stip forniula (lii DistrlaE Evaluitor'l Handbook of 
Selected EvQlyotion PrQcedurcs , p, 4549), Bifori eompUting this Ubli^ read all ^fgotnotii, Attach additional 
shaets if nicessaryi 
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Activity 
Code 


Test 
Usidi/ 


Forrn 


Uvel 


Total 


Group 


Number 
Tistid^^ 




Pridicted 
PostEe'st 
Hean 


Actual 

pQSttiSt 


StatiiElcal DflEE^ 


Code 


Prit 


lit 


Obtained 
Value 
of t 


Lsveii/ 
; of - 
signif- 
icanci 


ire 


Post 


Pre 


Post 


Date 


Mean 


Datp, 




6iO 
1 ! 


9 


1 

1 


5 


7 


2 


i -■ ■ 
0 


MAT 


G 


F/H 


m. 


ADV 


1175 


m 


. 925 


2/75 




5.22 




'7.1B 




(.001 


I ^ 


0 


9 


6 


7 


2 


0 


HAT 


G 


F/li 


m 




'1950 


lo-i: 


rim 


2/75 


6,3- 


6.63 




i7.52 


32.91 


<.0Q1 
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y Identify thi ta^E yied and year of publication (HAT^SBj CAT-.70, eto,). 

21 Total nuniber of partielpanEs^n the aetivityi * 

3/ Idintify the participanti by spiclflc grade level (isgii gradi 3> grada 5)* Where liveral gradis are coniblned, intir 

the lait two digits of the coniponEnt codi, 
£/ Total nunbar of paftidpanti ineludid in the pri and posttest eaUulations, * 
5/ Spicify lavel of atatiatical slgniflcanci obtalnad (eigi, p < ,05; pi*Ol), ^ 
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, OFFICE 0! EDUCATlOi-jiL EVALuMIUK • DMA LOjS FUilK . • 
(attach to Mil item !if30) Function # QQ-qQfi7a 

in thii table enter ill pta losi infonflition, Befi^een MIR, item WO and this fopi, all partie:^inti 
la eseh activity Eiuat be iccountid for* The conpoiiant and activity codes used in completion of itetn 
should be used here so that the to^o tables match, See definitions below table for further Initructlons, ■ 



Coaponeiit 
Codi 


Activity 
Code 


(1) 
Group 


(2) 
Test 
Used 


(3) 
Total 

N 


w 

Number 
Tested/ 
Analyzid 


0) ' 

participants 
Not Tested/ 
. Analyzid 


(6) 

Reaions why students were not tested, or If 
tested, were not flnilyzed 

Kusber/ 


N 


% 




liason _ 


6 


0 


9 


1 


5 


7 


2 


0 


801 


MAT 


1175 


927 


248 


22 


Insufficient achiivment data 




ittrition due to drop out • 


248 


6 


0 


9 


1 


6 


7 


2 


0 








1 


415 


21 


Insufficient achieifflient data 




attrition due to drop out from 


415 















































































































(1) Identify the participants by specific pide level (s,g*, gride 3, grade 9)i Where ssveral grades an coflibinid, 

enter the last two digits of the componint code, 

(2) Identify the tist used and year of publieation (MAT-?0, SDAT-?4, etc.), 

(3) Kuniber of participants in the activity, 

(4) Kunibir of participants included in the pri and posttest calculations found on ite#3l3, 

(5) Nunibaf and percent of parttciponts not tested ind/or not inslyied on iter#30, 

(6) Spiclfy aU reasona why students were not testid and/or analyzed. For iich riason spscifiidj provide a separiti 

nimber count, If any further docmentation la availibli, pleasi attach to this^feni, If further spaci ii 
needed to specify and explain data loss, ittach additional pages to this forin, ' i 



